Multi-modal Emotion Recognition – More "cognitive" Machines

نویسندگان

  • Velina Slavova
  • Hichem Sahli
  • Werner Verhelst
چکیده

Based on several results related to studies on emotions, we suggest that the process of emotionrecognition is assisted by some internal structure of the cognitive images of emotions, which are at different levels of knowledge representation. We concede that the main proposed in psychology models are in correspondence with these levels and in this sense complementary. We summarize the state-of-the-art of machine emotion recognition with regards of the used psychological models of emotions. In order to discover amelioration sources of multimodal machine emotion recognition, we propose a scheme of the cognitive process, based on gradual levels of representation. The proposed scheme shows several "strategic" differences with the architectures used in machine emotion recognition. We discuss the questions related to recognition, assisted by two levels of representation that we called "perceptual" and "conceptual". ACM Classification

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Remarks on Emotion Recognition from Bio-Potential Signals

This paper proposes an emotion recognition system from multi-modal bio-potential signals. For emotion recognition, support vector machines (SVM) are applied to design the emotion classifier and its characteristics are investigated. Using gathered data under psychological emotion stimulation experiments, the classifier is trained and tested. In experiments of recognizing five emotion: joy, anger...

متن کامل

Semi-supervised Bayesian Deep Multi-modal Emotion Recognition

In emotion recognition, it is difficult to recognize human’s emotional states using just a single modality. Besides, the annotation of physiological emotional data is particularly expensive. These two aspects make the building of effective emotion recognition model challenging. In this paper, we first build a multi-view deep generative model to simulate the generative process of multi-modality ...

متن کامل

Towards Efficient Multi-Modal Emotion Recognition

The paper presents a multi‐modal emotion recognition system exploiting audio and video (i.e., facial expression) information. The system first processes both sources of information individually to produce corresponding matching scores and then combines the computed matching scores to obtain a classification decision. For the video part of the system, a novel ...

متن کامل

Multi-Modal Emotion Recognition Fusing Video and Audio

Emotion plays an important role in human communications. We construct a framework for multi-modal fusion emotion recognition. Facial expression features and speech features are respectively extracted from image sequences and speech signals. In order to locate and track facial feature points, we construct an Active Appearance Model for facial images with all kinds of expressions. Facial Animatio...

متن کامل

Multi-Modal Emotion Recognition from Speech and Text

This paper presents an approach to emotion recognition from speech signals and textual content. In the analysis of speech signals, thirty-three acoustic features are extracted from the speech input. After Principle Component Analysis (PCA) is performed, 14 principle components are selected for discriminative representation. In this representation, each principle component is the combination of ...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2009